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Abstract 

The irreversibility in a statistical system is traced to its probabilistic evolution, and the molecular chaos assumption is not 
its unique consequence as is commonly believed. Under the assumption that the rate of change Pi(t) of the ith microstate 
probability Pi(t) vanishes only as t — > oo, we prove that the entropy of a system at constant energy cannot decrease with time. 



One of the outstanding problems in theoretical physics 
is the demonstration of thermodynamic irreversibility of 
Clausius's second law of thermodynamics [1]. Its reso- 
lution is vital as the second law, whether treated as an 
axiom or as a law, determines the way Nature evolves. 
What makes the second law so unique is that its irre- 
versibility is in stark contrast with reversibility obeyed 
by classical or quantum mechanics governing all processes 
in Nature; the only known exception is some Kaon decay 
over a short period of time. As Loschmidt [2| argued, 
thermodynamic irreversibility contradicts the reversibil- 
ity principle; thus, we may have to abandon one of them. 
Nature may be perfect, but our description of any macro- 
scopic part of it requires a probabilistic approach due 
to external noise; see later. It was first pointed out by 
Kroning and later developed by Boltzmann Q; see 
[H, 0] for excellent reviews. It was the first approach in 
physics that established that fundamental laws of Nature 
need not be strictly deterministic. Many phenomena at 
the microscopic level such as the nuclear decay are also 
known to require a probabilistic approach for their un- 
derstanding. Thus, the probabilistic interpretation is not 
just a consequence of a macroscopic nature of the system. 
Nevertheless, it has to be exploited for a proper under- 
standing of the second law. To appreciate this, we note 
that the Gibbs formulation of the entropy S(t) is 

S(t) = -J2Pi(t)^ Pi (t)>0, £)pi(t) = l, (1) 

where pi (t) is the probability of the ith microstate at time 
t; the sum is over all distinct W microstates. According 
to the second law, the entropy of an isolated system can- 
not decrease with time; see OA in Fig. [1] The probabil- 
ities change until the equilibrium is attained asymptoti- 
cally when S(t) — > In IF, its maximum possible value, as 
t — > oo, and all microstates have the same probability: 

Pi(t) —> 1/W and Pi(t) — * only when t — > oo, (2) 

where the dot denotes the derivative with respect to time. 

It is not just the microstates themselves, but their 
probabilities of occurrence that determine the entropy. 
As we demonstrate here, not appreciating this fact has 
given rise to the irreversibility paradox of Loschmidt. 
There have been several attempts to explain irreversibil- 
ity such as the Boltzmann i/-theorem, coarse-graining, 
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FIG. 1: Schematic behavior of S(t) as a function of time 
t. Starting at O (t = 0), OA and OB show the symmetric 
growth of S(t) in future and under time reversal at t = 0. If 
we reverse time later at t = to + 1' by setting t' — » —t', then 
OoC shows the growth of the entropy above its value S(to) 
at t = to; the entropy does not retrace OoO, as would be 
required by time-reversal invariance. 



the Brussels School of Prigogine, to name a few; see [7| for 
an excellent summary of these approaches. In particular, 
Boltzmann argued that time-reversibility remains intact, 
except that the time required to observe it is so long that 
it will never occur in one's lifetime. This is the custom- 
ary mechanical approach taken in statistical mechanics 
for an isolated system, where statistical methods (such 
as the use of ensembles, molecular chaos, etc.) are used 
only as a convenience for treating a macroscopic system, 
while deeply believing in its time-reversible evolution as 
a mechanical system. This is apparent from the extensive 
use of the Liouville theorem as a framework in develop- 
ing statistical mechanics as a tool Q. Our stochastic 
approach will deviate from this customary mechanical 
approach in simple but important ways. The origin of 
this probabilistic behavior is the stochastic interaction 
with the environment, no matter how weak @, 0], whose 
immediate consequence is to make interparticle collisions 
also stochastic. We only consider very weak environmen- 
tal interaction; otherwise, separating the system from the 
environment will not be useful [a, Hi. T he introduction of 
molecular chaos (MC) by Burbury j 1 01 ] and later adopted 



by Boltzmann ll| to explain irreversibility, however, ele- 
vates MC as the source for irreversibility. Unfortunately, 
the use of MC helps to conceal, rather than reveal, the 
true origin of irreversibility, as we will argue below. We 
will establish that (i) irreversibility is caused by stochas- 
ticity in the system which arise from interactions with 
the environment, (ii) MC is one of many possible mani- 
festations of it, and not the only one, and (iii) the entropy 
cannot decrease if we assume . 

The significance and relevance of our stochastic ap- 
proach to study system's evolution is convincingly 
demonstrated by the very simple but highly celebrated 
Kac ring model [H, El , which contains N balls of two 
colors A and B, localized on sites of a ring; there are 
no empty sites. A microstate i represents an ordered 
sequence of the colors of the balls. The time evolution 
occurs by balls moving in unison one step clockwise dur- 
ing each time interval A. To include the environmental 
effects, we consider F flippers with fixed positions on the 
links between neighboring sites that flip the colors of balls 
(A<^B) without any bias as they pass through the flip- 
pers. The movement of each ball is deterministic, even 
when it passes through a flipper. In one time step, the 
microstate i evolves into another unique microstate i'. 
We denote this time evolution by a one-to-one mapping 
i — > i' . It can be inverted to give the backward evolu- 
tion i' <— i under time reversal (t — » — i) by balls moving 
counter-clockwise; there is no effect on flippers' ability to 
flip colors under reversal as the balls pass through them. 
Thus, time reversal will generate uniquely any past state 
of the system so there is time-reversal invariance. The 
number of distinct microstates of balls is W = 2 N . For 
very weak external interactions, we need the flipper den- 
sity (p = F/N <C 1. Let Aj and Bj denote the number of 
A and B balls and a,j and bj the number of A and B balls 
with a flipper ahead of them at time tj = jA; the index 
j should not be confused with i for a microstate. Obvi- 
ously, Aj + Bj = N, and aj + bj = F, so that we can 
treat only one species (we choose B) as independent. It 
is easy to establish the following recursion relation (RR) 



We will choose the following form, merely for simplicity, 
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-bj. Introducing the densities Pj — Bj/N 



and Pj+i = bj/F, we can rewrite the RR for Pj 
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Pj + <p(l - 2pj). 



(3) 



This RR cannot be solved in a closed form, since it in- 
volves the quantity pj which is determined by the initial 
microstate and j. To proceed further, we need to supple- 
mented it by some known pj . The most direct way is to 
express pj as a function of Pj. We will call such an as- 
sumed relationship the reduction assumption. One such 
choice, following Burbury and Boltzmann, is that of MC, 
which for the current model leads to pj = Pj [HI, EH : the 
density of any color is independent of whether a flipper is 
ahead or not. However, many other forms can be utilized. 



\-2pj = e{^Pj) 



1 - 2Pj 
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here, 9j = 9(ip,Pj) is some arbitrary real positive func- 
tion, although with some strong restrictions to be de- 
tailed below. It includes MC (8 = 1) as a special case. 
It is one out of many possible choices, but is sufficient to 
make our point that the molecular chaos assumption is 
not unique for irreversibility to emerge. The functional 
form of 8j does not depend on time explicitly; implicitly, 
it may depend on j through Pj. The RR now becomes 
P j+1 = f(Pj), f(x) = x+6tp(l-2x) = 6p+(l-26tp)x < 
1 over < x < 1, where 9,x stand for 0j((p,x),Pj, re- 
spectively. The fix point (FP) x* of the RR is given 
by f(x*) = x* . The restriction f(x) < 1 strongly re- 
stricts 9. In addition, we require that (a) 9(ip,x) has no 
zero over < x < 1, (b) the slope at x — x* = 1/2 
satisfies < f'(x*) < 1, and (c) f(x) is monotonic. Sat- 
isfying all these requirements will usually impose certain 
restrictions on the allowed values of if. For example, 
for 9 = 9q =constant, it is easy to see that ip < 1/26q. 
With these requirements, the schematic form of f(x) is 
as shown in Fig. [2j its convexity is not relevant. The 
RR can now be solved recursively to obtain the limiting 
value P eq of Pj as j — » oo, which represents the FP. To 
find x* of the RR Xj+i = f(xj), we proceed graphically 
and follow the arrows in Fig. [21 as we approach x* . The 
starting point may be above shown in the fig- 

ure, or below (not shown); in both cases, we converge 
to the FP x* = 1/2. Thus, x* is an attractive FP and 
determines the equilibrium state in the model. 

The form of f(Pj) is determined by the dynamics of 
the system; despite this, the FP, i.e., the equilibrium 
state is the same for all dynamics described by the above 
class of functions f(Pj). This class of f(Pj) also gives a 
monotonic decreasing (increasing) sequence of Pj, which 



converges to the FP P e< 



1/2, if the initial state 



is above (below) x*. The FP P cq = 1/2 results from our 
adopted unbiased dynamics. The monotonic behavior is 
in accordance with our fundamental postulate Such 
a behavior, which follows from our reduction assumption, 
creates a contradiction with the time reversal invariance 
of dHJ). What is even more puzzling is that the reduction 
assumption has no explicit stochastic ingredient. Thus, 
the RR appears to have a completely deterministic form: 
we can reverse the arrows in Fig. [5] and retrieve the 
entire history [Pj = / _1 (P, + i)]. Despite this, we have an 
irreversible asymptotic (j — > oo or t — > oo) approach to 
equilibrium brought about by the reduction assumption. 

To understand how the reduction assumption leads to 
irreversibility, we proceed as follows. We change the 
above deterministic model to a stochastic model by in- 
troducing stochasticity: We make the positions of the 
flippers random at each time step A to mimic stochastic 
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FIG. 2: The function f(x), tp 7^ 0, shown schematically as 
the thin curve, while thick straight line at 45° angle repre- 
sents x. To find the fix point x* , one follows the arrows 
— ► 1 2 3, • • • , starting at 0. The time evolution is 
due to interactions with the exterior (tp 7^ 0). When there is 
no external interaction (tp = 0), the state never changes with 
time, as expected. It is clear that it will take infinte number 
of iterations of the recursion relation Xj+i = f(%j) to find 
the fix point. Under time-reversal, one follows the arrows in 
reverse •■■ ,3-^2^1^0to retrieve the initial point 0. 



external interactions. This means that there is a flip- 
per present with a probability tp ahead of each ball. We 
also assume balls to be uncorrelated, and focus on one 
of the balls. Let Pj denote the probability that its color 
is B at time tj] this probability should not be confused 
with the density Pj above for the deterministic system; 
there was no stochasticity earlier. Each flipper flips color 
with probability 8j = 6(tp,Pj), and does not flip it with 
probability l — 6j. Then, it is easy to see that 

p j+i = (1 - t P )p j + tp(i - efiPi + <p$ s (i - p s ) 

= P j + tp0 j (l-2P j ), (5) 

which is identical to the RR ([3]) for the deterministic 
model subjected to ([4]) if we identify the probability Pj 
with the density Pj. One can also interpret the above 
RR by assuming that there is a flipper on each link with 
certainty and it flips the color with probability tp9j and 
does not flip it with probability 1 — tpOj . As before, the 
stochastic RR ([5]) converges monotonically to equilibrium 
(Pj — > P cq = |) as tj — > 00, see Fig. [5J so that there 
are equal numbers of balls of the two colors. Thus, the 
probability of any of the W — 2 N microstates is exactly 
(1/2) N in accordance with our fundamental postulates 
(J2j). It is clear now that the reduction assumption (we 
have considered one of many possible classes of /) is re- 
ally a consequence of our stochastic model. A class differ- 
ent than (U) relating pj with Pj may result in a different 



equilibrium state. However, even in this case, the dy- 
namics will be irreversible. Thus, there is nothing unique 
about the Burbury-Boltzmann MC assumption or our re- 
duction assumption as far as irreversibility is concerned. 
The former is really one of many conceivable reduction 
forms that emerge as a consequence of an irreversible dy- 
namics. We should point out that ([5]) can be inverted 
for the probabilities :Pj = f~ 1 (Pj+\). Graphically, this 
requires reversing the arrows in Fig. [2j which will even- 
tually yield the initial probability Pq. However, as we will 
see below, this inversion of the probability RR does not 
correspond to time-reversal evolution of the microstates. 
Thus, it says nothing about the reversibility of the second 
law. For the molecular chaos case, it is easy to show 

Pj =Pc q + {l- 2tp) j (P - P cq ). 

Now that we have seen that MC is no longer a unique 
manifestation of irreversibility, we need to look for a 
much deeper cause of irreversibility, as a variety of dy- 
namics will lead to irreversibility. Thus, a particular dy- 
namics itself cannot be the unique cause of irreversibility. 
We propose that it is the stochastic nature of a statistical 
system that is responsible for time irreversibility 0]. Its 
presence invalidates the time reversal invariance. We now 
justify this proposal. Let us first consider a deterministic 
evolution in which an initial microstate i at time t = 
evolves in a unique fashion. From |T]), 5(0) = 0. Let 
us consider times that are integral multiple tj = jA in 
terms of some fixed interval A. Then i evolves into a mi- 
crostate ij (i — > ij) at a future time tj with certainty, i.e. 
with probability one, to use the language of probability. 
Again, using fl}, S(tj) = 0. The deterministic dynamics 
possesses the property of time-reversal invariance. Since 
the evolution i — > ij is one-to-one, strict causality ("from 
the same antecedents follow the same consequents") is 
maintained and the mapping can be inverted at any time. 
Thus, the forward evolution « — > ii — ^ ^2 — ^ • ■ ■ — ^ 
of an initial microstate can be uniquely inverted to give 
ij <— <— ij-i i\ «— i, and we recover the 

initial microstate in this reversal. The entropy in this re- 
versal remains constant^ 0, which is consistent with the 
time-reversal invariance. The macroscopic irreversibil- 
ity observed in a macroscopic system should also not be 
confused with the chaotic behavior seen in a system with 
only a few degrees of freedom, the latter being purely de- 
terministic and, therefore, should not be considered an 
example of time-irreversibility from what we said above. 

For the concept of entropy to be useful requires a par- 
ticular kind of probabilistic approach in which the evo- 
lution must not be deterministic, even though one can 
use densities such as Pj above for a deterministic system 
as a suggestive probability; rather, it must be genuinely 
stochastic. As Landau observes Q, even an isolated sys- 
tem is not truly deterministic in Nature. A real sys- 
tem must be confined by a real container, which forms 
the exterior of the system. The container cannot be a 
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perfect insulator. Moreover, it itself will introduce envi- 
ronmental noise in the system. Thus, there are always 
stochastic disturbances going on in a real system due to 
the exterior, which cannot be eliminated, though they 
can be minimized. (For the Kac ring model, we must 
ensure ip <C 1, but we must not have tp = 0; in the lat- 
ter case, the probabilities Pj will never change and the 
entropy will remain constant as we have a deterministic 
evolution.) For quantum systems, this requires consid- 
ering the Landau-von Neumann density matrix, rather 
than eigenstates @. The derivation in Q clearly shows 
the uncertainty introduced by the presence of " outside" . 
The latter is not being part of the system, just as the 
flippers are not used in identifying the microstates and 
their density does not affect the FP in the Kac model. 

We do not have to consider the actual nature of the 
noise; all that is required is its mere presence. One can 
think of <p in the Kac model as the strength of stochastic 
noise. As long as ip ^ (or tpd ^ 0), the model will always 
converge to the FP, i.e. will equilibrate. It is only in this 
case that the entropy will increase as the probabilities of 
various microstates change in time, as we prove below. 
The actual nature of the noise will only determine the 
form of the dynamics, but not the final equilibrium state, 
which remains oblivious to the actual noise or the dynam- 
ics. This is what allows the statistical mechanical ap- 
proach to make predictions about the equilibrium state. 
Since the evolution is stochastic, a microstate i makes a 
"jump" to one of the W microstates in the microstate set 
{J}. The mapping i {/} is one-to-many, with each of 
the possible %' € {1} occurring with certain probabilities. 
Because of the one-to-many nature, the mapping cannot 
be inverted to study time-reversal, and strict causality is 
destroyed. To appreciate this observation, let us consider 
the Kac ring model. Under time-reversal, the balls move 
counter-clockwise, but flippers continue to flip colors with 
the same probability ip6. Thus, i' gives rise to two possi- 
bilities so the mapping still remains one-to-many, which 
causes irreversibility:P J+ i does not go to Pj. Thus, time 
reversal and arrow reversals are not the same. 

Let us reverse time at t = to > 0, where the entropy 
is S(to); see Fig. Q] Then all possible microstate in the 
set {/} will not uniquely jump back into i; rather each of 
the possible i' will stochastically jump to any of the W 
microstates in the set {/}, and the entropy will continue 
to increase from its value S(to). This is shown by OoC in 
Fig. Q] The entropy will not follow OoO. The stochastic- 
ity destroys time-reversal invariance of the dynamics at 
to > 0. The situation is different at t = 0, when the sys- 
tem was initially prepared in some non-equilibrium state. 
If we follow its evolution in past and in future separately, 
we will discover that the entropy continues to increase 
until equilibrium is reached in both cases; see OA and 
OB in Fig. [TJ Thus, time-reversal invariance is valid 
with respect to t = 0, but not when t > 0. 

We now consider a general system, which is initially 



prepared so that the initial probabilities pio = Pi(t = 0) 
of various microstates are not zero. From p]). we see 
that if the initial probabilities pm > 1/W for some mi- 
crostates, then these probabilities must decrease (p; < 0). 
On the other hand, if p.^ < 1/W for some microstates, 
then these probabilities must increase (p, > 0). Accord- 
ingly, we partition microstates into two distinct groups Q 
(containing microstates with pi > 1/W) and C (contain- 
ing microstates with Pi < 1 /W) . We will assume po is the 
smallest of all probabilities in the group Q. We treat po 
to be the dependent variable, while all other p^s, i > 0, 
are treated as independent variables, so that po > 1/W 
is given by po = 1 — Yli>oPi- We nn< ^ ^hat 

dS/dt = ^2pi(dS/dpi) = J~]pi]n(po/pi)+y]pi ln(po/pi). 

i>o ieg tec 

As the two factors in each of the two sums have the same 
sign, dS/dt > 0. This establishes that the entropy con- 
tinues to increase until Pi(t) — » for all microstates, in 
which case <j2j) finally becomes satisfied. During time- 
reversal dynamics, the derivatives Pi(t) will have changed 
their signs, making dS/dt < 0, so that the second law is 
not violated. 

For a deterministic evolution, the entropy remains a 
constant of motion [9(. This is consistent with the Liou- 
villc theorem according to which the volume of the phase 
space is a constant of motion under deterministic dynam- 
ics, and which also does not violate the second law. In 
our opinion, the stochastic interpretation adopted here 
easily explains Maxwell's idea [ljjthat molecular motion 
is "perfectly irregular"; this irregularity must be present 
in order for the system to behave irreversibly. Our ap- 
proach is sufficient to show irreversibility; one does not 
really need to use the oscillatory behavior of the H-curve 
[8| as proposed by Boltzmann to resolve the paradox. 
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